Similarity-Based Retrieval and Solution Re-use Policies in the Game of Texas Hold'em
نویسندگان
چکیده
In previous papers we have presented our autonomous poker playing agent (SARTRE) that uses a memory-based approach to create a betting strategy for two-player, limit Texas Hold’em. SARTRE participated in the 2009 IJCAI Computer Poker Competition where the system was thoroughly evaluated by challenging a range of other computerised opponents. Since the competition SARTRE has undergone case-based maintenance. In this paper we present results from the 2009 Computer Poker Competition and describe the latest modifications and improvements to the system. Specifically, we investigate two claims: the first that modifying the solution representation results in changes to the problem coverage and the second that different policies for re-using solutions leads to changes in performance. Three separate solution re-use policies for making betting decisions are introduced and evaluated. We conclude by presenting results of self-play experiments between the pre and post maintenance systems.
منابع مشابه
Investigating the Effectiveness of Applying Case-Based Reasoning to the Game of Texas Hold'em
This paper investigates the use of the case-based reasoning methodology applied to the game of Texas hold’em. The development of a CASe-based Poker playER (CASPER) is discussed. CASPER uses knowledge of previous poker scenarios to inform a betting decision. CASPER improves upon previous case-based reasoning approaches to poker and is able to play evenly against the University of Alberta’s Pokib...
متن کاملDecision Generalisation from Game Logs in No Limit Texas Hold'em
Given a set of data, recorded by observing the decisions of an expert player, we present a case-based framework that allows the successful generalisation of those decisions in the game of no limit Texas Hold’em. We address the problems of determining a suitable action abstraction and the resulting state translation that is required to map real-value bet amounts into a discrete set of abstract a...
متن کاملA Heuristic-Based Approach for a Betting Strategy in Texas Hold'em Poker
Artificial intelligence research in Texas Hold’em poker has recently mainly focused on heads-up fixed limit game. Game theoretic methods used in the poker agents capable of playing at the very best level are not easily generalized to other forms of Texas Hold’em poker. In this paper we present a general approach to build a poker agent, where the betting strategy is defined by estimating the exp...
متن کاملPotential-Aware Automated Abstraction of Sequential Games, and Holistic Equilibrium Analysis of Texas Hold'em Poker
We present a new abstraction algorithm for sequential imperfect information games. While most prior abstraction algorithms employ a myopic expected-value computation as a similarity metric, our algorithm considers a higherdimensional space consisting of histograms over abstracted classes of states from later stages of the game. This enables our bottom-up abstraction algorithm to automatically t...
متن کاملUsing game theory approach to interpret stable policies for Iran’s oil and gas common resources conflicts with Iraq and Qatar
Oil and gas as the non-renewable resources are considered very valuable for the countries with petroleum economics. These resources are not only diffused equally around the world, but also they are common in some places which their neighbors often come into conflicts. Consequently, it is vital for those countries to manage their resource utilization. Lately, game theory was applied in conflict ...
متن کامل